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■ . Abstract We apply techniques of subriemannian geometry on Lie groups and of optimal synthesis 

I ' on 2-D manifolds to the population transfer problem in a three-level quantum system driven by two 
laser pulses, of arbitrary shape and frequency. In the rotating wave approximation, we consider a 

' nonisotropic model, i.e., a model in which the two coupling constants of the lasers are different. The 

^ . aim is to induce transitions from the first to the third level, minimizing 1) the time of the transition 

' (with bounded laser amplitudes), 2) the energy transferred by lasers to the system (with fixed final 

. time). After reducing the problem to real variables, for the purpose 1) we develop a theory of 

^>«^ ' time optimal syntheses for distributional problem on 2-D manifolds, while for the purpose 2) we 

. use techniques of subriemannian geometry on 3-D Lie groups. The complete optimal syntheses are 

\l ' computed. 

o : 
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' 

c3 ; 1 Introduction 

^ : 

', 1.1 Statement of the Problem 
> ■ 

. The problem of designing an efficient transfer of population between different atomic or molecular levels is 
K% ' crucial in many atomic-physics projects [5, 20, 26, 34]. Often excitation or ionization is accomplished by using 

. a sequence of laser pulses to drive transitions from each state to the next state. The transfer should be as 
■ ■ ■ ' efficient as possible in order to minimize the effects of relaxation or decoherence that are always present. In the 
recent past years, people started to approach the design of laser pulses by using Geometric Control Techniques 
(see for instance [18, 19, 25, 31]). Finite dimensional closed quantum systems are in fact left (or right) invariant 
control systems on SU (n), or on the corresponding Hilbert sphere S*^""^ C C", where n is the number of atomic 
or molecular levels. For these kinds of systems very powerful techniques were developed both for what concerns 
controUabihty [3, 21, 24, 32] and optimal control [1, 9, 22]. 

The most important and powerful tool for the study of optimal trajectories is the well known Pontryagin 
Maximum Principle (in the following PMP, see for instance [1, 22, 30]). It is a first order necessary condition for 
optimality and generalizes the WeierstraB conditions of Calculus of Variations to problems with non-holonomic 
constraints. For each optimal trajectory, the PMP provides a lift to the cotangent bundle that is a solution 
to a suitable pseudo-Hamiltonian system. Anyway, giving a complete solution to an optimization problem 
(that for us means to give an optimal synthesis, see for instance [6, 9, 16, 29]) remains extremely difficult for 
several reasons. First, one is faced with the problem of integrating a Hamiltonian system (that generically is 
not integrable excepted for very special costs). Second, one should manage with "non Hamiltonian solutions" 
of the PMP; the so called abnormal extremals . Finally, even if one is able to find all the solutions of the PMP, 
it remains the problem of selecting among them the optimal trajectories. For these reasons, usually, one can 
hope to find a complete solution to an optimal control problem in low dimension only ([2, 9, 15, 33]). 
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In this paper we apply techniques of subricmannian geometry on Lie groups and of optimal synthesis on 
2-D manifolds to the population transfer problem in a three-level quantum system driven by two external fields 
(in the rotating wave approximation) of arbitrary shape and frequency. The dynamics is governed by the time 
dependent Schrodinger equation (in a system of units such that h= I) 

^'-^-mt), (1) 

where = (^i(.), V'2(.), V'3(-))^ : [0, T] ^ C^, ^-=1 IV-.WI' = 1 (i-C, m belongs to the sphere S'' C C^), 
and 

/ El iiiTi \ 
H = A*i-^r E2 M2^2 , (2) 
V ^i2Ti E3 J 

where E2 and E3 are real numbers representing the energy levels. Here (*) denotes the complex conjugation 
involution. The controls !Fi{.), !F2{-), that we assume to be measurable functions, different from zero only in a 
fixed interval, are the external pulsed field, while > 0, {j ~ 1, 2) are the couplings (intrinsic to the quantum 
system) that we have restricted to couple only levels j and j + 1 hy pairs. 

Using standard arguments of controllability on compact Lie groups and corresponding homogeneous spaces, 
one gets the following (see the recent survey [32] or the papers [3, 10, 11, 21, 24]): 

Proposition 1 Assume that there exists constants Mi^ M2 > such that \ui{t)\ < Mi and \u2{t)\ < M2 for 
a.e. t > 0. Then there exists a time r(Mi,M2) such that the control system (1), (2) is completely controllable 
in time t{Mi,M2). 

The model (1), (2) belongs to a class of systems on which it is possible to eliminate the so called drift term 
(i.e., the term diag{Ei, E2, E3)) by a unitary change of coordinates and a change of controls (see Section 1.2). 

The aim is to induce complete population transfer from the state one (iV'iP = l)j called source , to the 
state three (iV'sP = l)j called target, minimizing the criteria described in the following. 



Energy in fixed time 

r {\:Fi{tr + \:F2{tr) dt, (3) 

Jo 

This cost is the energy of the laser pulses. After elimination of the drift and reduction to a real problem 
(see below) , the problem of minimizing this cost becomes a singular-Riemannian problem (or a subricmannian 
problem when lifted on the group 50(3), see Section 1.2) and was studied in [11], in the "nongeneric" case 
in which /ii = fi2- In the following we call the problem (1), (2), (3) isotropic if fii = fi2 otherwise we call 
the problem nonisotropic. For the cost (3), to guarantee the existence of minimizers, the final time T should 
be fixed, and such minimizers are parameterized with constant velocity (|.Fi|^ + \J^2\'^ = const). Moreover 
the controls are not assumed a priori bounded. Anyway if the final time T is fixed in such a way the minimizer 
is parameterized by arclength (|.Fi|^ + \J-2\'^ = 1), then minimizing the cost (3) is equivalent to minimize the 
time, with moduli of controls constrained in the closed set 

\Ti\' + \T2\'<l. (4) 

For this cost we can normalize /ii = /i2 = 1 in the isotropic case, while /ii = 1, /i2 = a > for the nonisotropic 
case. Notice that this change of notation modifies the costs only by an multiplicative constant. 

Time virith bounded controls 

Another interesting cost is the time of transfer under the conditions 

|.Fi(t)| < i/i and |.F2(t)| < z^2. (5) 
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In this case we call the problem isotropic if /iii^i = /i2i'2- Otherwise we call the problem nonisotropic. Let us 
notice that if we do not require the constraints (5), then there is no minimizer. 

For this cost we can normalize fii = = fi2 ~ 1^2 ~ ^ the isotropic case, while /ii = i^i = 1, /i2 = a > 0, 
1^2 = 1 for the nonisotropic case. 

After these normalizations the Hamiltonian and the costs read 
/ El Ti \ 

H = \ Tl E2 aT2 , (6) 
V cxTl ^3 / 

energy in fixed time: l {\,Tx{t)f + \T2{t)f) dt, (7) 

time with bounded controls: T = / \ dt, with \Tx{t)\ < 1 and \ J^2{t)\ < 1. (8) 

Jo 

In the following we call the parameter a the nonisotropy factor. 

Remark 1 The problem of inducing a transition from the first to the third eigenstate, can be formulated, as 
usual, at the level of the wave function V'(t), but also at the level of the time evolution operator (the resolvent), 
denoted here by g{t). We have il}{t) — g{t)il;{0), g{t) € t/(3), g{0) = id. For g{t) the Schrodinger equation (1) 
reads g{t) — -'iHg{t). In the following we call the optimal control problem for ^{t) and for g{t) respectively 
the problem downstairs and the problem upstairs. In this kind of problems one can take advantages of working 
both upstairs and downstairs depending on the specific task. This approach happened to be successful in some 
other problems of optimal control on Lie groups, see for instance [14]. Notice that the evolution of the trace 
part is decoupled from the rest. It follows that we can always assume Ei + E2 + = {) and g{t) e SU{?>). 

This paper is the continuation of a series of papers on optimal control of finite dimensional quantum systems 
[10, 11, 12]. In [10], the problem of minimizing the energy of the lasers pulses was studied for a two-level system 
and for an isotropic three-level system. The two-level system (that is a problem on SU{2)) was completely 
solved (in this case minimizing energy is equivalent to minimize time with bounded controls), while the three- 
level problem (that upstairs is a problem on 5J7(3)) was solved assuming resonance as hypothesis (i.e., controls 
oscillating with a frequency equal to the difference of the energy levels that the laser is coupling, see formula (9) 
below). Thanks to this assumption, the problem (downstairs) could be reduced to a two-dimensional problem 
and solved completely. In [11] the problem of minimizing the isotropic energy in the three- level problem was 
treated without assuming resonance as hypothesis. In that case, even if the optimal control problem lives in 
a space of big dimension (dim{SU{3)) ~ 8), it was possible to get explicit expressions of optimal controls and 
trajectories thanks to the special structure of the Lie algebra of the problem and to the fact that the cost is 
built with the Killing form, that renders the Hamiltonian system associated to the PMP Liouville integrable. 
In that paper resonance was obtained as consequence of the minimization process and explicit expressions of 
amplitudes were provided. In [12], the possibility of restricting to resonant controls was generalized to n-level 
systems and to more general costs. More precisely consider a n-level system of the kind 

^ V(-) :=(V'i(.),->«(.)r: [0,T]->C", EJ^.P = 1, 

where D = diag{Ei, En) and V{t) is an Hermitian matrix {V{t)j^k ~ ^(Ofcj)i whose elements are either 
identically zero or controls, (i.e., Vij = or Vi,j ~ i^ijEij, for i < j, the term Fij being the external pulsed 
field coupling level i and level j). Then for a convex cost depending only on the moduli of controls (i.e., 
amplitudes of the lasers), like those described above, it was proved that there always exists a minimizer in 
resonance that connects a source and a target defined by conditions on the moduli of the components of the 
wave function (e.g. two eigenstates) : ^j.k{t) — Uj,/c(t)e'[^^'~-^'=^*+^3'fcl^ i < j = 1, ...,n, where (,j^k & [— 7r,7r] are 
some phases and Uj^k{.) : [0,T] — > M are the amplitudes of the lasers that should be determined. This result 
permits to reduce the problem to real variables (i.e., from SU{n) to SO{n) upstairs, or from S"^""^ C C" to 
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5""^ C K" downstairs), and therefore to simplify considerably the difficulty of the problem (see below for the 
reduction to real variables in the 3-level case) . 

In the present paper we take advantage of this procedure to find complete solutions to the optimal control 
problem for the three level quantum system (1), (6) and the costs (7), (8). More precisely: 

A. the minimum time problem with bounded controls (downstairs) is a problem in dimension five. In this 

case, since the dimension of the state space is big, the problem of finding extremals and selecting optimal 
trajectories can be extremely hard. The fact that one can restrict to minimizers that are in resonance 
permits to reduce the problem to a two-dimensional problem, that can be solved with techniques similar 
to those used in [9]. This is the goal of Section 4; 

B. the minimum energy problem is naturally lifted to a right invariant subriemannian problem on the group 

SU{3) (as explained in Remark 1). This problem cannot be solved with the techniques used in [11] for 
the isotropic case, because now the cost is built with a "deformed Killing form" . Anyway since we can 
restrict to resonant minimizers the problem is reduced to a contact subriemannian problem on 50(3), 
that does not have abnormal extremals (since it is contact) and the corresponding Hamiltonian system is 
completely integrable (since it leads to a right invariant Hamiltonian system on a Lie group of dimension 
3, see for instance [22, 23]). The complete solutions can be found in terms of Elliptic functions. This is 
the aim of Section 5. 

Remark 2 Thanks to the reduction given in [12], a minimum energy problem for a n- level system, with levels 
coupled by pairs, is a singular-Riemannian problem on 5""^ or can be lifted to a right invariant subriemannian 
problem on SO{n). Anyway there is no reason to believe that the Hamiltonian system associated to the PMP 
is Liouville integrable for n> A. See [13] for some numerical solutions to this problem for n = 4. 



1.2 Reduction to Real Variables 

In the following, for the 3-level problem (1), (6) we recall how to reduce the problem to real variables using the 
fact that we can restrict to resonant controls, i.e., controls of the form 

T^{t) = u,(t)e^[(^^+i-^^)*+«^l, J = 1,2, (9) 

where e [— tt, tt] are some phases and Uj{.) : [0, T] R are the amplitudes of the lasers that should be 
determined. Using the so called interaction picture, i.e., making the unitary transformation 

i!{t) ^ U-\t)i^{t), where U{t) := diag{e-'^\e-'^' ,e-'^'), (10) 

and next making the transformation (to kill the phases) 

V'(<) -> V-^ij{t), where V := diag{l, e*(-'^/2-«i), g'^-'^-^i-^^)), (11) 

the Schrodinger equation becomes 

dV(i) 



dt 



= H{t)m- (12) 



Notice that these transformations leave invariant the source = 1 and the target [V'sj^ = 1- Now, one can 
restrict equation (12) to reals (i.e., to the sphere 5^, i.e., tjj{.) : [0,T] K'^, tpf + il!2 + ipi = 1) by taking a real 
initial condition (the initial phase is arbitrary). Thus the drift is eliminated and the Hamiltonian belongs to 

50(3) 



H = \ ui -au2 . (13) 
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For more details on these transformations, see [10, 11, 12]. After reduction to real variables, the states one and 
three are represented respectively by the couples of points (±1,0,0)"'" and (0,0, ±1)^. And the costs in which 
we are interested become: 



energy in fixed time: 



{ui{tf + U2{tf)dt, 



(14) 



time with bounded controls: T = I 1 dt, under the conditions |Mi(i)| < 1 and |w2(i)| < 1- (15) 

Jo 

Remark 3 Beside the proof that there always exist minimizers in resonance, another useful result given in [12] 
is that (after reduction to real variables), there always exists a minimizer corresponding to positive coordinates 
(and it is also given the description of how to reconstruct all other resonant minimizers from this last one). 
Hence we can assume ip G where S*"*" is the subset of the sphere S'^ corresponding to positive coordinates 



{t/j (-01, V2, V'a)^ 



(16) 



Let Lip{[0, r], S'^) be the set of Lipschitz functions from [0, T] to S'^ . Our minimization problem, in which we 
precise the functional spaces, is: 

Problem dovimstairs (PD) Consider the control system (12), (13), where u,{.) e L°°([0,T],M) (i = 1,2), 
tpi-) G Lip{[0,T], S^). Find the optimal trajectory and control steering the point "0 = (1,0, 0)''" (still called 
source or state one), to the point ip = (0,0, 1)"^ (still called target or state three), that minimizes the cost (I4) 
or (15). 

Remark 4 We attack the problem by computing all trajectories in 5*+, starting from (1,0, O)"'", and satisfying 
the PMP (the so called extremals ) . Then we have to select, among all extremal trajectories reaching the target, 
those having smallest cost. Since we will find that all extremals passing through a point of 5+ \ {(1,0,0)^} 
coincide before this point, we get a stronger result than a solution to the problem (PD). Indeed, we obtain the 
complete optimal synthesis, i.e., a set of optimal trajectories starting from (1,0,0)"^ and reaching every point 
of S'^. For a more sophisticated definition of optimal synthesis, see [9, 29]. The optimal synthesis can be useful 
for applications, when one needs to reach a final state that is not an eigenstate. 

For what concerns the problem upstairs, after the transformations (10), (11) the equation for the operator of 
temporal evolution is 



g{t) = Hg{t), 



(17) 



where now g{t) G 50(3) and H is given by (13). To pass from the problem upstairs to the problem downstairs, 
one should take the first column of g(t), i.e., should use the projection 



n : 5-0(3) 
9 



52 

ffV(O) -5(1,0,0)^. 



(18) 



Upstairs the source and the target are not points, but are respectively the sets S and T of matrices of SO (3) 
that projected with (18) give rise to (1,0, 0)-^ and (0, 0, 1)-^. More precisely we have 





1 1 


^ 




S := 





50(2) 

) 


= SO{2) c 50(3), 



r 



go S, where go 






1 




G 50(3), i.e., T = 





50(2) 




I 1 


/ 



(19) 



(20) 



Notice that 5 is a subgroup of 50(3) while T is not (indeed it is a translation of a subgroup). The problem 
upstairs is finally: 



5 



Problem upstairs (PU) Consider the control system (13), (17) where Ui{.) G L°°([0,T],R) (i 1,2), 
g{.) € Lip{[0,T], SO{3)). Find the optimal trajectories and controls connecting the source S to the target T 
that minimize the cost (14) or (15). 

Remark 5 Notice that after elimination of the drift, both control systems (12), (13), and (13), (17) can be 
rewritten in the form (called distributional ) 

y^uiFi{y) + U2F2{y), (21) 

where y G S*^ downstairs, or y G 5*0(3) upstairs and 



F,iy) - 1 \ y, F^iy) 





A problem with a dynamics (21) and cost (14) belongs to the frameworks of subriemannian geometry and 
singular- Riemannian geometry (see [4. 27]). 

Using standard arguments of controllability on compact Lie groups and corresponding homogeneous spaces, 
one gets the following: 

Proposition 2 After elimination of the drift term and reduction to real variables, the control system upstairs 
(13), (n) (resp. the control system downstairs (12), (13)) is completely controllable on 50(3) (resp. on S^). 

Remark 6 Notice that both problems (PD) and (PU) can be seen as minimum time problems on a compact 
manifold with velocities in a convex compact set (and there is complete controllability). Then, by Filippov 
theorem, they have solutions (see for instance [17]). 



1.3 Structure of the Paper 

In Section 2 we state PMP, our main tool, and we show that, for our minimization problems, there are no 
abnormal extremals. In Section 3 we state our main results. In Section 4 we treat the minimum time problem 
downstairs. In Subsection 4.1 we develop a theory of time optimal syntheses on 2-D manifolds for distributional 
systems with bounded controls (this subsection is written in such a way to be as self-consistent as possible) 
and in the next subsection we build explicitly the time optimal synthesis. In Section 5, attacking the problem 
upstairs, we treat the minimum energy problem. We give explicit expressions of the optimal controls, for which 
the corresponding trajectories form an optimal synthesis on 5^. 



2 Pontryagin Maximum Principle 

Our main tool is the Pontryagin Maximum Principle (PMP), stated below for the two cases in which the final 
time is free or fixed. For the proof see for instance [1, 30]. In this version the source and the target are not 
just points, but more generally smooth submanifolds. This is useful while working upstairs (where the source 
and the target are defined respectively by (19) and (20)). 

Theorem (Pontryagin MsLximum Principle) Consider the control system i = f{x,u) with a cost of the 
form f^{x{t),u(t)) dt, where the final time T is free, and initial and final conditions given by x{0) G Min, 
x{T) € Mfin, where x belongs to a manifold M and u{.) : [0, oo[^- U C M™. Assume moreover that M, /, 
are smooth and that Mi„ and Mfin cire smooth submanifolds of M . 
Define for every (x. A, u) € T*M x U 

W{x, A, u) < A, f{x, u) > +Xof°{x, u). 

If the couple {x{.),u(.)) : [0, T] M x U (with u{.) measurable and essentially bounded, and x{.) Lipschitz) is 
optimal, then there exists a never vanishing Lipschitz function (A(.),Ao) : i G [0, T] > (A(t),Ao) S T*^^^M x K 
(where Xq < is a constant) such that for a.e. t € [0,T] we have: 
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i) i{t)^^{x{t),X{t),u{t)), 

ii) m^-^ix{t),xit),uit)), 

iii) M{x{t),X{t),u{t)) ^■MM{x{t),\{t)), where Mm {x,\) := max^gy M(a;, A, w). 
iiii) MMix{t),X{t)) =0. 

v) < A(0), Tj.(o)Mi„ >=< X{T),Tx(T)Mfi„ >= (transversality conditions). 

If the final time T is fixed by hypothesis, then condition iiii) must be replaced by 

iiiibis) TfiMixit), X{t)) ^ k{T) > 0, for some constant k{T). 

Definition 1 The map A(.) : [0,T] —^ T*f^^-^M is called covector . The real-valued map on T*M x U, defined in 
(22) is called PMP-Hamiltonian . A trajectory x{.) (resp. a couple {x{.),X{.))) satisfying conditions i), ii), iii) 
and iiii) (or iiiibis)^ is called an extremal (resp. an extremal pair). If (x{.), X{.)) satisfies i), ii), iii) and iiii) 
(or iiiibis) ) with Ao = (resp. Ao < 0), then it is called an abnormal extremal (resp. a normal extremal ). 

Remark 7 Notice that the definition of abnormal extremal does not depend on the cost but only on the 
dynamics (in fact if Aq = 0, the cost disappears in (22)). For general properties of abnormal extremals, we 
refer to [7, 27]. 

Proposition 3 For the control systems downstairs (12), (13), there are no abnormal extremals. The same 
holds for the control system upstairs (13), (11). 

Proof. For the problems (12), (13) and (13), (17), the set of admissible velocities at a point x writes {uiFi(x) + 
u^Fi^x) I (u\,u-2) e (7}, where the set C/ is a subset of containing in its interior. This implies that, if 
there were an abnormal extremal, its covector A(.) should annihilate F\ and Fi all along the trajectory, but 
also, using PMP, their bracket [Fi,i^2]. But for both problems (PD) and (PU), (Fi, Fa, [Fi, Fa]) forms a 
generating family of the tangent space which implies that A(.) = 0, all along the trajectory. This is forbidden 
by the PMP. ■ 



3 Main Results 

In this section we present explicitly the optimal controls steering state one to state three for our two costs. 
The optimal syntheses are presented in Sections 4 and 5 and pictured in Figures 3 and 6. In both cases, all 
the extremals issued from (1, 0, 0)^ given by the PMP are optimal in and they leave in finite time. For 
the minimum energy problem, there is no cut-locus, i.e., two optimal trajectories starting from the source at 
time zero, cannot intersect for positive time. On the other side, for the minimum time problem, two optimal 
trajectories can intersect for i > 0, but in this case they coincide before the intersection. 

Remark 8 Notice that due to the symmetries of the problem, for both costs, if (wi(.), U2(.)) : [0, T] ^ R x M 
are the optimal controls steering the state one to the state three and corresponding to a nonisotropy factor a, 
then ('0i(.),U2(.)) : [0,aT[^MxR, defined by (ui(i), U2(t)) := {u2{T - t/a),ui(T - t/a)), are the optimal 
controls steering the state one to the state three and corresponding to a nonisotropy factor 1/a. 

3.1 Minimum Time 

For the minimum time problem, optimal controls are a.e. piecewise constant, and the corresponding trajectory 
is a concatenation of arcs of circle. There are three different cases depending on the value of a: 

Case < a < 1 . In this case the minimizer corresponds to the control: 

• ui{t) = U2{t) = 1 for t e [0, ^ [■ The corresponding trajectory steers the point (1,0,0)^ to 

the point (0, Vl — a^, a)'^ . 
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ui{t) ^ 0, U2{t) = 1 for t e ''"yi+g" + ^^^^77^]- The corresponding trajectory steers 



the point (0, vT^c?, a)'^ to the point (0, 0, 1)"^. 

Case a = 1 . In this case the minimizer corresponds to Ui{t) — U2{t) = 1 for i e [0, -^=\ and steers the state 
one to the state three. 

Case Q > 1 . In this case the minimizer corresponds to: 

• ui{t) — 1, U2{t) = for t G [0, arccos(^)[. The corresponding trajectory steers the point (1,0,0)-^ 



to the point (1 y'l- -2^,0)^. 

ui{t) ~ U2{t) = 1 for < e [arccos(i), arccos(i) + --^=i= arccos(— ^)]. The corresponding trajectory 



steers the point (i, yl — ^jO)"^ the point (0,0,1)-^. 
3.2 Minimum Energy 

For the minimum energy problem, there exists a unique strictly positive number TO3(0) such that the trajectory, 
corresponding to the controls given below, steers the state (1,0, 0)^ to the state (0, 0, 1)^ and is parameterized 
by arclcngth. The parameter 7713(0), appearing in these formulas, should be computed numerically, for instance 
by the dichotomy method presented in Section 5.3.4. 

Case < a < !• ui{t) ~ cn [a 7713(0) t; k) , U2{t) ~ sn {a 7773(0) t; k) , where we have defined the modulus 
of the elliptic functions cti and sn to be equal to fc = a\n^(o) • 

Case g > 1 . ui{t) = cd t; kj , U2{i) = \/l — k^ sd ^ ^"^"^ t; fc^ , where we have defined the modulus 

of the elliptic functions cd and sd to be equal to fc = a'i7n3'{o)^+a'^-i ■ 

For the parameter 7773(0) we have the following estimate: \J^^^ < 7713(0) < — 1, if < a < 1, and 

< 777,3(0) < if a > 1. The time needed to reach the target is given by formula (65) if a < 1 and by 
formula (67) if a > 1. In the particular case a = 1, we recover the results of [11]. 

4 Minimum Time 

4.1 Minimum Time for Distributional Systems on 2-D Manifolds 

In this section, we develop a theory of time optimal syntheses on 2-D manifolds for distributional systems with 
bounded controls. For this purpose we use ideas similar to those used by Sussmann, Bressan, Piccoli and the 
first author in [8, 15, 28, 35, 36] for the minimum time stabilization to the origin for the "control affine version" 
of the same problem (x = F{x) +uG{x), u G [—1, 1], where x belongs to a 2-D-manifold) and recently rewritten 
in [9]. This section is written to be as self-consistent as possible. 

4.1.1 Basic Definitions and PMP 

We focus on the following: 

Problem (P) Consider the control system 

x^uiFi{x)+U2F2{x), xeM, \u,\<l, i^l,2, (22) 

where 

(HO) M is a smooth 2-D manifold. The vector fields Fi and F2 are C°° and the control system (22) is complete 
on M. 
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We are interested in the problem of reaching every point of AI in minimum time from a source Min that is a 
smooth submanifold of M . 

The theory developed next is then apphed to (PD): 



1 I I ^2 I = I V^l |=-^2— +^1^ 




2 



(23) 



i^2(V')=| -a I ( ^2 I =a I -V-a I ="("^3^+ 



Definition 2 A control for the system (22) is a measurable function u{.) = (mi(.), U2(.)) ■ [01,02] 

The corresponding trajectory is a Lipschitz continuous map x{.) : [oi, 02] — > M such that x{t) = ui{t)Fi{x{t)) + 

U2{t)F2{x{t)) for almost every t G [fli, 02]. Since the system is autonomous we can always assume that [ai, 02] = 

[0,T]. 

For us, a sohition to the problem (P) is an optimal synthesis that is a collection {(a;j(.), Ug(.)) defined on 
[0,Tj],a; S M} of trajectory-control pairs such that a;j(0) G M^, XxiT^) = x, and Xx{-) is time optimal. 

In the following we use the notation u ~ (ui^u-i) and (in a local chart) x = {x\,X2)^ F\ ~ ((^1)1,(^1)2), 
F2 = ((^2)1, (^2)2)- Let us introduce a definition to describe different types of controls. 

Definition 3 Let u{.) ~ (wi(.), U2(.)) : [01,02] C [0,T] [—1, 1]^ be a control for the control system (22). 

• u{.) is said to be a bang control if for almost every i G [ai, 02], u{t) = u G {( — 1, ^1), (^Ij 1), (I7 ^l), (l, !)}• 
Similarly u{.) is said to be a Ui-bang control if for almost every t G [ai, 02], Ui{t) — uE {±1}- 

• A switching time of u{.) is a time t G [01,02] such that for every e > 0, u{.) is not bang on (t — e,i + e)n 
[01,02]. Similarly a m-switching time of u{.) is a time t G [01,02] such that for every e > 0, u{.) is not 
Ui-bang on (t — e,t + e) D [oi, 02] . 

• If UA '■ [01,02] [—1,1]^ and ub ■ [02,03] [—1,1]^ are controls, their concatenation un * ua is the 
control 

f / ""^C*) ^ ^ [01,02], 

^ ' \ UB{t) /or t g]o2,03]. 

The control u{.) is called bang-bang if it is a finite concatenation of bang arcs. Similarly one defines 
Ui -bang-bang controls. 

• A trajectory of (22) is a bang trajectory, (resp. bang-bang trajectory), if it corresponds to a bang control, 
(resp. bang-bang control). Similarly one defines Ui-bang and Ui-bang-bang trajectories. 

A key role is played by the following three functions defined on M 



Ab,(x) 
Ab,(x) 



= Det{Fi{x)),F2{x))^{FiUF2)2-{F2)i{Fi)2, (24) 
= Det{Fi{x)),[Fi,F2]{x))^{Fi)i{[FuF2])2-{[FuF2MFi)2, (25) 
= Det{F2ix)),[Fi,F2]ix)) = iF2)i{[Fi,F2])2-{[Fi,F2])i{F2)2. (26) 



Notice that these definitions depend on the choice of the coordinate system, but not the sets A^^(O), A^^(O), 
A^^(O) of their zeros, that are respectively the set of points where Fi and F2 are parallel, the set of points 
where Fi is parallel to [Fi, F2] and the set of points where F2 is parallel to [Fi, F2]. Using PMP it turns out (see 
Section 4.1.2) that these loci are fundamental in the construction of the optimal synthesis. In fact, assuming 
that they are embedded one-dimensional submanifolds of AI , we have the following: 
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• in each connected region of M \ (A^^(O) U A^^(O) U A^^(O)), every extremal trajectory is bang-bang 
with at most two switchings (one of the control ui and one of the control U2). Moreover the possible 
switchings are determined. More precisely for every x G M \ (A^^(O) U A^^(O) U A^^(O)) define 

/.(.):^-^. m 

If fi > (resp. fi < 0), we have that Ui can only switch from —1 to +1 (resp. from +1 to —1); 

• the support of Ui-singular trajectories (that are trajectories for which the u^-switching function identically 
vanishes, and for which Ui can assume values different from ±1, see Definition 4 below) is always contained 
in the set A^;^(0). 

For the problem (P), the PMP says the following: 

Corollary (Pontryagin Maximum Principle for the problem (P)) Consider the control system (22) 
subject to (HO) . For every (x, A, u) e T*M X [-1, if, define 

M{x,X,u) := Ml < A,Fi(a-) > +ii2 < A,F2(x) > +Ao, 

If the couple {x{.),u{.)) : [0,T] M x [—1,1] x [—1,1] is time optimal then there exist a never vanishing 
Lipschitz continuous covector A(.) : t G [0,r] X{t) G T*^^-^M and a constant Aq < such that for a.e. 

t G [o,r].- 

i) x{t)=^{x{t),\{t)Mt)), 

ii) A(t) - ~^{x{t),X{t),u{t)) =-< Xit),{ui{t)WF, +U2mF2)(x{t)) >, 

iii) W{x{t),X{t), u{t)) = WMix{t),X{t)), where Wm{x, A) := max{M(x, A, u) : u G [-1, 1]^}, 
iiii) WM{x{t),Xit))^0, 

v) < A(0), Tj.(-o)A/i„ (transversality condition). 

Remark 9 In this version of PMP, A(.) is always different from zero otherwise the conditions iii), iiii) would 
imply Ao = (cf. PMP in Section 2). An extremal is said to be nontrivial if it does not correspond to controls 
a.e. vanishing. Notice that a trivial extremal is an abnormal extremal. In the following we often refer to 
nontrivial abnormal extremal (NTAE, for short). 



4.1.2 Switching Functions, Singular Trajectories and Predicting Sv^^itchings 

In this section we are interested in determining when the controls switch from + 1 to — 1 or viceversa and when 
they may assume values in ] — 1, -|-1[. Moreover we would like to predict which kind of switchings can happen, 
using properties of the vector fields Fi and F2. A key role is played by the following: 

Definition 4 (Switching Functions) Let {x{.),X{.)) he an extremal pair. The corresponding switching func- 
tions are defined as 4>i{t) .—< X{t), Fi{x{t)) >, i ~ 1,2. 

Remark 10 Notice that (l>i{.) are at least Lipschitz continuous. Moreover using the switching functions, condi- 
tions iii) and iiii) imply: 

M(a;(t), X{t),u{t)) = ui{t)(j)i{t) + M2(t)02(t) + Ao = a.e.. (28) 

The following lemma characterizes abnormal extremals. 

Lemma 1 Let (a;(.),A(.)) (defined on [01,02]^ be an extremal pair. We have: 

1. (x(.), A(.)) is an abnormal extremal if and only if = (t>2{-) = on [01,02]; 

2. if {x{.), X{.)) is an abnormal extremal, then Supp{x{.)) C A^"'^(0); 

3. if {x{.), X(.)) is not an abnormal extremal, then 0i(.) and 02(-) never vanish at the same time; 

4. let i G [01,02] be a time such that 4>i{t) = 0, x(t) G A^"'^(0), Fi{x{t)) 7^ 0. Then [x{.),X{.)) is an abnormal 
extremal. The same holds if (j)2{t) — 0, x{t) G A^"'^(0), F2{x{t)) 7^ 0. 
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Proof. Let us prove 1. The sufficiency is obvious. Let us prove the necessity. Equation (28), with Aq = and 
iii) of PMP, imply that both controls vanish (trivial abnormal extremals) or that <?5'i(.) = 4'2{-) = on [ai, 02]. 
Let us prove 2. From = 02(0 = we have that A(.) is orthogonal to Fi{x{.)) and F2{x{.)). Since A(.) 

is never vanishing, it follows that Fi{x{.)) is parallel to F2{x{.)). To prove 3, assume by contradiction that 
(x(.), A(.)) is not an abnormal extremal and that there exists a time t for which 0i(t) = (jj-iit) = 0. From (28) 
there exists a sequence tm t such that ui(i,„) and U2{tm) are defined and ui{tm)4'ii'tm) +U2itm)<t'2itm) + ^0 = 
0. Since (f>i{tm) — *■ 0, i = 1,2, it follows Aq = 0. Contradiction. To prove 4., observe that (/)i(f) = implies 
that X{t) annihilates Fi{x{t)). From x{t) G A^^(O) we have that F2{x{t)) is parallel to Fi{x{t)), hence A(f) 
annihilates also F2{x{t)). It follows (j)2{t) = 0. From (28) we have Aq = 0. The same proof is valid exchanging 
the two indexes 1 and 2. H 

The following lemma restricts the set where the support of abnormal extremals can live. 

Lemma 2 Let (x(.), A(.)) be an abnormal extremal. Then Supp{x{.)) C A^^(O) H A^^^(O) H A^^(O). 

Proof. Let x{.) defined on [01,02] be an abnormal extremal. Then condition 2. of Lemma 1 implies that 
Fi and F2 are parallel along Supp{x{.)). It follows that the distribution restricted to Supp{x{.)) is integrable 
in the Frobenius sense. Hence also [^"1,^2] is parallel to Fi and F2 along Supp{x{.)). By definition of A^. it 
follows that A^, Abj, A^a are zero along x{.). H 

We recall that for the problem (23), there are no abnormal extremals (cf. Proposition 3). Anyway, as a 
consequence of Lemma 2, the presence of NTAE is highly nongeneric also for the general system (22) subject 
to (HO), since generically, points of A^^(O) n Ag^(O) n A^^(O) are isolated. 

The switching functions determine when the controls switch from +1 to —1 and viceversa. In fact, from the 
maximization condition iii), one immediately gets: 

Lemma 3 Let (a;(.), A(.)) defined on [0,T] be an extremal pair and the corresponding switching functions. 
If 7^ for some t G]0,r[, then there exists e > such that x{.) corresponds to a constant control 

Ui = sgn((j)i) on ]t — e,t + e[. Moreover if (f)i(.) has a zero at t, and if (j)i{t) exists and is strictly larger than zero 
(resp. strictly smaller than zero) then there exists £ > such that x{.) corresponds to constant control Ui = —1 
on \t — e, t[ and to constant control Ui = +1 on ]i, t + e[ (resp. to constant control ui = +1 on ]t — s, t[ and to 
constant control Ui = —1 on ]t, t + e[). 

Notice that on every interval where has no zero (resp. finitely many zeroes) the corresponding control is 
Mi-bang (resp. Ui-bang-bang). We are then interested in differentiating 0^. One immediately gets: 

Lemma 4 Let (a:;(.), A(.)), defined on [0,T] be an extremal pair and <j)i{.) the corresponding switching functions. 
Then it holds a.e. 4)i{t) = U2{t) < X{t), [F2, Fi]{x{t)) >, 02(0 = ui{t) < A(t), [Fi, F2]ix{t)) > . 

From Lemma 3 it follows that Ui can assume values different from ±1 on some interval [01,02] only if the 
corresponding switching function vanishes identically there. 

Remark 11 Lemma 1 asserts that, if there are no NTAE (as for the system (23)), then ui and U2 never switch 
at the same time. In this case, from Lemma 4 it follows that in a neighborhood of a iti-switching, <?!>i(.) is a 
function. A similar statement holds for 4>2{-)- 

Definition 5 A nontrivial extremal trajectory x[.) defined on [oi, 02] is said to be ui-singular if the correspond- 
ing switching function (t>i{.) vanishes identically on [01,02]. 

Remark 12 From Lemma 1 it follows that {x{.), A(.)) is a NTAE if and only if it is a iti-M2-singular trajectory. 

Next we show that an extremal trajectory, between two Ui-switchings, intersects the set A^^(O) U A^|(0) U 
A^^(O). Moreover we prove that Ui-singular trajectories must run on the set Ag^{Q). Let us define two crucial 
functions. 

Definition 6 On the set of points x M \ A^^(O), the vector fields Fi{x), F2{x) form a basis of T^M 
and we define the scalar functions fi{x), f2{x) to be the coefficients of the linear combination: [i^i, _F2](a;) = 
f2ix)Fiix)~ fiix)F2ix). 
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The following Lemma gives a relation between /i, f2, and the functions A^, A^j^, A^a- 
Lemma 5 Let x e M \ A^'^{0) then f,{x) = -^r4~T' * = 1:2. 

Proof. We have As, (a;) ^ Det{F^{x), [F^,F2]{x)) = Det{Fi{x), h{x)Fi{x) - h{x)F2{x)) = 

= — fi{x)Det(^Fi{x),F2{x)) = —fi{x)AA{x), and similarly for A^^- H 



The functions /i and /2 are crucial in studying which kind of switchings can happen near iti-ordinary points 
defined next: 

Definition 7 A point x e AI is called a Ui-ordinary point if x ^ A^"'^(0) U Ajj^(O). 

On the set of u^-ordinary points the structure of optimal trajectories is particularly simple: 

Proposition 4 Let C M he an open connected set made of Ui- ordinary points. Then all extremal trajectories 
x{.) : [01,02] — > fi, are Ui-bang-bang with at most one m- switching. Moreover if fi > (resp. fi <0) infl then 
x(.) corresponds to control Ui that is: 

• a.e. constantly equal to +1, or 

• a.e. constantly equal to —1 or 

• has a — 1 ^ +1 switching (resp. has a +1 ^ — 1 switching). 

Proof. Let x{.) : ]ai, a2[— > fi be an extremal trajectory and (/>i(.) be the corresponding ui-switching function. 
If 0i(.) has no zero, then is a Ui-bang and the conclusion follows. Let <i be a zero of (/>i(.). The time 
ti cannot be a zero of (p2{-) otherwise x{ti) could not be a u^-ordinary point (by Lemma 1 we would have 
AA{x{ti)) ~ 0). From Lemma 4 it follows that 4>i{-) is in a neighborhood of ti. Moreover ti cannot be 
a zero of 4>i{.) otherwise x(ti) could not be a wi-ordinary point (we would have ABi{x{ti)) = 0). Since in a 
neighborhood of ti, U2 is a.e. constantly equal to +1 or —1, we can assume U2 constant in this neighborhood, 
and we have 

^i{ti) = U2{ti) < X{ti),[F2,Fi]{x{ti)) >=U2{ti) < A(<i),(-/2Fi +/iF2)(a;(ti)) > 

= U2{ti)fi{x{ti)) < X{ti),F2{x{ti)) >^U2{ti)fi{x{ti)) Mh). (29) 

Now from Lemma 3 we have that sgn{u2{ti)) = sgn{(j}2{ti)), and since </>2(ii) 7^ it follows sgn{(j)i{ti)) = 
sgn{fi{x{ti))). Using again Lemma 3, it follows that if /i > (resp. /i < 0) then we can have only a — 1 ^ +1 
switching (resp. a +1 — > — 1 switching). A similar proof can be done for a zero of 02- H 

We are now interested in properties of Wi-singular trajectories. 

Lemma 6 Let (x{.), X{.)), defined on [0,T], be a Ui-singular trajectory on [01,02] C [0,T], then Supp{x{.)\i^g^^ ^j^]) C 
Ab!(0). 

Proof. If {x{.), A(.)) is a NTAE, the conclusion follows from Lemma 2. Assume now that (x(.), A(.)) is not a 
NTAE. To simplify the notation assume i = 1, the case i = 2 being similar. From (l>i(.) =< A(.), Fi{x{.)) >= 
on [ai,a2] we have that 0i(.) = U2{-) < Fi]{x{.)) >= a.e. in [ai,a2]. Since (x(.),A(.)) is not a 

NTAE, it follows that U2 is a.e. equal to +1 or —1 in [01,02]. Therefore A(.) is orthogonal both to Fi{x{.)) 
and [Fi, F2]{x{.)). Being A(.) nontrivial then Fi(a;(.)) is parallel to [i^i, ^2](a;(-))- The conclusion follows. H 



Lemma 7 Let (x(.),A(.)) be a ui-singular trajectory (resp. a U2-singular trajectory) on [01,02]. Assume 
< VAs^(x(i)),Fi(x(t)) >^ (resp. < VAs^ (a;(0): ^2 (a;(t)) >^ 0) and define respectively 

u^ <^^BAxit)),F2ix{t)) > ^^^ <VABAm),Fiixit)) > 

■= -"^(*)<VA,,(.(0),Fi(.(t))>' •= -^^^'KvABAxmF2ixit))>- 

Then (pi{.) (resp. (p2i.)) satisfies |v3i(<)| < 1 (resp. [1^32(^)1 < a.e. in [01,02]. Moreover x{.) corresponds to 
the control ((^i(.), W2(.)) (resp. (ui(.), (/52(-)) [01,02]. 
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Figure 1: Hypotheses on A^^(O) (Figure A). Possible positions of the vector fields Fi and F2 on A^^(O) (Figure 
B). Shape of the synthesis in a neighborhood of a point where a trajectory is becoming u^-singular (Figure C) 



Proof. Assume i = 1, the case i = 2 being similar. Let ui(.), U2(-) be the controls corresponding to x{.), 
that is x{t) = ui{t)Fi{x{t)) + U2{t)F2{x{t)), for almost every t. From ABi{x{t)) ~ 0, we have for a.e. t: 
0= f^AB,[x{t)) ^ VABA^it)) ■ {,ui{t)Fi{x{t)) + U2{t)F2ix{t))). This means that Ui{t) = ipi{t). The condition 
|<Pi(i)| < 1 is simply a consequence of the fact that, by assumption, a;(.) is an admissible trajectory. H 

Remark 13 Notice that the three functions A^i, A^^, A^^ are not invariant by change of coordinates and/or 
orientation of M . Anyway, the sets of their zeros, the functions fi (see Definition 6) and the functions ipi (see 
Lemma 7) do not depend on the coordinate system. 

4.1.3 More on Singular Trajectories 

From Lemma 6 it follows that the condition A^^(O) 7^ is necessary for the presence of a u^-singular trajectory. 
Anyway in general it is not sufficient. It may very well happen that A^^(O) 7^ and no singular trajectory is 
running on it. Another common situation is that a singular trajectory is running just a subset of A^^(O). 

The description of singular trajectories is very intricate in general (sec for instance [9] for the control affine 
case). Here we describe what happens in the simplest case (that is enough for what follows), i.e., when we 
restrict our attention to a subset 5*1 of A^|(0) satisfying the following conditions: 

(CI) Si is a smooth one-dimensional connected embedded submanifold of M, 

(C2) Si does not intersect A2^{0) and Ag|(0), 

(C3) Si is not tangent to the vectors Fi + F2 and —Fi + F2, 

(C4) fi changes sign on Si. 

See Figure 1 A. Similarly, we restrict our attention to a subset iS'2 of Ag^(O) satisfying the same conditions 
(C1)-(C4), but with the indexes 1 and 2 exchanged. 

Let us treat the case of Si, being the case of 6*2 similar. First observe that, if a ui-singular trajectory 
defined in [01,02] is running on Si, then U2 cannot switch on [01,02], otherwise, by Lemma 1, x{.) would be 
a NTAE (and this is not the case thanks to (C2)). Assume, for instance, U2 — 1- Due to (C3), Fi + F2 
and —Fi + F2 point either on the opposite, or on the same sides of Si (see Figure 1 B, cases 1 and 2). Since 
the admissible velocities belong to the segment joining Fi + F2 and —Fi + F2 it follows that, only in case 1 
of Figure 1 B, it is possible to run on Si. Moreover, using a similar argument to that of Lemma 12 p. 47 of 
[9], one can prove that if /i < on the side where Fi + F2 points, then a trajectory running on Si cannot be 
optimal. These facts are collected in the following: 

Lemma 8 Let Si (resp. S2) he a subset of M satisfying conditions (CI), (C2), (C3), (C4) above. Then on 
Si (resp. on S2) cannot run an optimal ui-singular trajectory (resp. an optimal U2-singular trajectory) if (at 
least) one of the two conditions is satisfied. 
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001 Fi + F2 and —Fi + F2 (resp. Fi + F2 and Fi F2) point on the same side 0/ Si (resp. S2); 

002 Fi + F2 and —Fi + F2 point on opposite sides of Si (resp. Fi + F2 and Fi — F2 point on opposite sides 
of S2), and in a neighborhood of Si (resp. S2) we have the following. On the side where points Fi + F2, 
we have /i < (resp. f2 <0). 

If on Si (resp. on 6*2) OOl and 002 are not satisfied (that means that 5*1 is a candidate support for an 
optimal trajectory) then, following [9], we call Si a ui-turnpike (resp. a U2-turnpike). 

An extremal trajectory x{.), corresponding to control ui constantly equal to +1 or —1 and reaching a 
Mi-turnpike at a point x = x{t), can enter it only if the corresponding ui-switching function is vanishing at 
t, otherwise, after t, it will correspond to the same control. Moreover, using an argument similar to that of 
Lemma lip. 46 of [9] one can prove that if an extremal trajectory enters a turnpike, then it can exit it with 
control +1 or —1 at every successive time. These facts are stated in the following Lemma, and illustrated in 
Figure 1 C. 

Lemma 9 Let {x{.), A(.)) defined on [0, a], a > 0, be a bang extremal pair that verifies x{a) ~ x, x d Si where 
Si is a Ui-turnpike, and assume that 4)i{a) =< \{a) , Fi{x{a)) >— 0. Moreover let b,c be two real numbers, 
sufficiently close to a, such that a < b < c, and let x'{.) : [0, c] M be a trajectory, corresponding to controls 
u'i{.) and U2(.) such that: 

• a^'(-)l[o,a] = 

• Supp(x'{.)\[a,b]) C Si, and u'j{.), j ^ i, is bang on [0, c], 

• x'{.)\]b,c] -is bang. 

Then x'{.) is extremal. Moreover, if is the Ui- switching function corresponding to x'{.), then 4''i\[a^b] = 0- 

Remark 14 For the problem (P), under generic conditions on the vector fields Fi and F2, one can classify 
synthesis singularities, stable syntheses, singularities of the minimum time wave fronts, with the same techniques 
used in [9]. 

4.2 Time Optimal Synthesis for the 3-Level Quantum System 

In this section, we apply the theory developed in Section 4.1 to the system (23). Here our source is the point 
(1,0,0)"^ and the task is to reach the target (0,0, 1)"^ in minimum time. As explained in Remark 4, the first 
step is to compute all extremal trajectories in S~^ . Then we have to select, among all extremal trajectories 
reaching the target, the one having smallest cost. Since it turns out that all these trajectories are optimal 
(because all extremals passing through a point of 5+ \ {(1, 0, 0)"^} coincide before this point) it follows global 
optimality, and we get the complete time optimal synthesis in S~^ . 

When one is dealing with a minimum time problem for a linear system x = Ax + Bu, x G M^, A £ R^^^, 
B G M^, u G [—1,1], the equation for A(.), given by PMP, is decoupled from the equation for x{.) and does 
not contain the control, hence for every value of A(0) one can compute X(t) and the corresponding switching 
function < X{t), B > from which one determines the value of the control. For our problem (23), as consequence 
of bilinearity, the equation for A(.) does not depend on x{.), but still contains the control. For this reason we 
have to use the theory developed before, that uses the functions A^, A^. , fi. 

One of the most important points is to prove that there is no chattering (i.e., an infinite concatenation of 
bang and/or singular arcs in finite time). In synthesis theory this step is called the finite dimensional reduction 
because it permits to restrict the set of candidate optimal trajectories to a family of trajectories parameterized 
by a finite number of parameters (the switching times). The absence of chattering is proved in Proposition 8. 
Thanks to that, we will be able to prove that every optimal control is piecewise constant and this permits to 
solve explicitly the equation for A (see Section 4.2.2). 
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Figure 2: The vector fields Fi, F2, [^1,^2], the sets A^'^{0), A^^(O). A^^(O), and the functions /i and /2 on 
S+. 



4.2.1 Preliminary Computations and Facts 

From (23) we have in the standard coordinates of 



[Fi, F2]{ip) ^ a [ -i>3—— + ipi—— ] , A^ = aV'2, Ab^ = aipi, Ab^ = -a^i/'3- 



a , d 

oipi otps 
Hence 

A^\0) = {yjeS+ \yj2^0}, Agl{0) ^ {yj e S+ \ ^ 0}, A~l{0) = {i/j e S+ \ yj^ = 0} . 

They form the boundary of 5+. Using Lemma 6, tlie two sets A^^(O), A^^(O) permit to locate singular 
trajectories (if they exist). Now we want to compute the values of the singular controls, i.e., the functions (pi 
and ip2 defined in Lemma 7. They are identically equal to zero where they are defined. Indeed A^^ = atpi, 
hence F2 is orthogonal to VA^i on A^J^(O). Notice that ipi is not defined when Fi is also orthogonal to the 
gradient of A^^, (hence when Fi and F2 are parallel, that is along A^^(O)), anyway at these points tpi can be 
defined by continuity. A similar computation works for (p2- These facts are collected in the following: 

Proposition 5 If an extremal trajectory x{.) is ui-singular (resp. U2-singular) in [01,02] C [0,T], then, in 
[01,02], it corresponds to control Ui (resp. U2) equal to zero and its support belongs to A^^(O) (resp. A^|(0)J, 
i.e., the circle of equation ^1 = (resp. ips — 0). 

Now let us study which switchings are admitted. In 5+ we have 

fiW = -^<0, where V2 7^0, Vi^O, 

■02 
1p3 

.f2{ip) = a— > 0, where '(/'2 7^ 0, 7^ 0. 

-02 

Remark 15 Using the sign of these two functions one immediately checks that in the set A^| (0)\{(0, 1, 0)"^, (0, 0, 1)"'"} 
is a ui-turnpikc and the set Agl{0) \ {(1,0,0)^, (0, 1,0)^} is a U2-turnpike. 

Hence using Proposition 4 we get: 

Proposition 6 In S+ \ (A;:^^(0) U A^^^(O)) (resp. S+ \ (A;:^^(0) U Agl{0))) every extremal trajectory has at 
most one Ui-switching (resp. one U2- switching) according to the following rules: Ui : +1 — > —1, {resp. U2 : 
-1— .+1). 

Since there are no abnormal extremals, using 4. of Lemma 1, one gets the next proposition, that is useful in 
the following to prove that there is no chattering. 
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Proposition 7 Let (a:;(.),A(.)) defined on [0,T] be an extremal pair. Lett G [0,r] be such that x{t) <E A^"'^(0)\ 
{(0,0,1)^} (resp. x{t) e A^\0) \ {(1,0,0)^};. Then ^ (resp. M^it)) ^ Oj. 

The next proposition sliows that every extremal is a finite concatenation of bang and singular arcs. 

Definition 8 Let A(.)) defined on [0, T] be an extremal pair. A time t G [0, T] is said to be a chattering time 
if there exists a nontrivial sequence i„, tending to t, with ui oru2 being not bang or singular on any neighborhood 
of t„ . 

Proposition 8 Let (a;(.),A(.)) defined on [0,T] be an extremal pair. Then no i ^ [^^T] is a chattering time. 

Proof. Let us prove the proposition for W2, being the proof for ui equivalent. Assume by contradiction that 
there exists a time i € [0, T] of W2-chattering and that the chattering is on the left of i, being the opposite case 
equivalent. By Proposition 6, x{t) is not in 5*+ \ (A^^(O) U A^^(O)). Moreover since 02(^) = 0, by Proposition 
7 we have that x{t) does not belong to Aa^{G) \ {(1,0,0)^}. Hence x{t) e A^,^(0). 

We claim that there are two times ti and T2 such that < ri < T2 < xiji) G A^^(O) and .t(t2) ^ A^^(O). 
Indeed, if it is not the case, then on some interval ]t — e,t[ (e > 0), the support of is included in A^^(O) 
or in 5+ \ A^^(O) and in both cases there is no chattering. As a consequence of the form of the dynamics (see 
Figure 3), in S*^, an extremal can leave and come back to Ag|(0) only having a +1 —1 switching of U2 in 

\ A^^(O) which is forbidden by Proposition 6. H 

Remark 16 Thanks to Propositions 5 and 8, every extremal trajectory corresponds to piecewise constant controls , 
i.e., it is a finite concatenation of arcs of circle . 

Remark 17 Once the control ui (resp. U2) takes value —1 (resp. 1) on a nontrivial interval of time, it will not 
switch anymore in . Indeed, outside Ag^(O) (resp. A^^(O)) it cannot switch (see Proposition 6), and the 
trajectory cannot reach A^^(O) (resp. Ag|(0)) with control ui ~ —1 (resp. U2 = 1). 

4.2.2 Construction of the Synthesis 

In the following we construct the complete time optimal synthesis. First we write a (linear) system of equations 
for the switching functions and its solutions along a bang or singular arc, that can be easily verified: 

Proposition 9 Let {x{.),X{.)) defined on [0,T] be an extremal pair. Recall that 4)i{.) A(.), Fi(x(.)) >, 
I = 1,2 and define 4>3{.) .=< A(.), [Fi, F2]{x{.)) >. Then, along a bang or a singular arc, the triplet (ipi t 4*2 t (ps) 
is solution of the time invariant ODE 



-lt2(^3 
"103 



(30) 



= a^U2(f)i - ui4>2. 



have 




(31) 



where 



R{t) = 



V 



lii^+a'^ U2'^ cos{t V^i'^+ct'^ u^"^) 

Q'^ ui U2 ( — l+cos(i '\/ui'^-{-a'^ ■ii2^)) 

a." U2 sin{t \/u\'^-\'(y.'^ U2'^) 
U2^ 



Ui U2 ( — H-cos(i ViTT^+a^lI^) ) 



U2'^ -\~ui^ cos{t \/ u-i'^-\-OL^ u\ 

Ul^+Q-^ U2^ 

u\ sin{t \/u\^-\-OL^ U2'^) 
V^ii^+a^ U2'^ 



U2 sin{t \/'Ui^-t-a^ ^2^) \ 

^/ui'^~\-OL^ U2^ 

cos(i -s/up" 



'■U2^) ) 



(32) 



Since there is no chattering, we have: 
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Proposition 10 For every extremal trajectory x{.) such that x(0) (1,0,0)"'", there exists e > such that it 
corresponds to controls (wi,U2) = (liO), or to control (ui,U2) = (lil). [0,e]- 

Proof. Since (1,0,0)^ ^ Ajj|(0), ui cannot be zero for small times. Moreover ui = —1 or U2 = —1 do not 
permit to x{.) to enter S^. H 



Remark 18 Notice that, since Fi, F2 and [Fi, F2] is a generating family of the tangent space, the knowledge of 
A is equivalent to the knowledge of {(pi, (f>2, 'Pa)- Since the initial covector A(0) is free, one have some freedom 
on the choice of ((/)i(0), (/)2(0), 03(0)). More precisely, starting from the point (1,0,0)^, we have ^2(0) = 
(because F2 = 0), (/>i(0) > (otherwise ui would not be 1 for small time) and (^3(0) is free. Moreover, since 
the covector is defined up to a positive constant, we can normalize 4>i{0) = 1. 

Notice also that a iti-singular (resp. U2-singular) extremal defined on [a,b] has 4>i{.) = (psi-) — (resp. 
M-) = M-) = 0) on [a,b]. 

In the following propositions, we study in details the two extremals starting from (1, 0, 0)"^ and corresponding 
to controls (1,0) and (1,1) and the possible switchings along them. Notice that if a < 1 then the trajectory 
corresponding to controls ui = M2 = 1 intersects the boundary of on Ag^{0) while if a > 1 it intersects the 
boundary of S+ on A;^^(0). 

Proposition 11 The trajectory starting from (1,0,0)^ and corresponding to control ui ~ +1, U2 ~ is 
extremal up to time tt/2 (i.e., until it leaves S^). Moreover for every a €]0,7r/2[ there exists £ > such that 
the trajectory starting from (1, 0, O)"'" and corresponding to control (1, 0) in [0, a] and to control (1, 1) in ]a, a + e] 
is extremal. 

Proof. The first claim is immediately checked by plugging iti = 1, U2 = inside the equations (31) and (32) 
for time t € [0, and choosing initial covector in such a way that <^i(0) = 1 and 02(0) = 03 (0) = 0. Since along 
this extremal the 0i(.) are constant it follows that the trajectory starting from (1, 0, O)"'" and corresponding to 
control Ml = +1, U2 = is extremal until it leaves . 

The second claim can be seen as a consequence of Lemma 9. Anyway, it can be checked directly by setting 
01 (0) = 1, 02(0) = 03(0) = and plugging = 1, U2 = inside the equation (31) and (32) for time t G [0, a] 
and ui = 1, M2 = 1 for time t s]a, a + e]. Finally one have to check that 0i(.) and 02(-) remain positive for an 
£ small enough. H 

Similarly one gets the following: 

Proposition 12 The trajectory starting from (1,0, 0)"'" and corresponding to control Ui — +1, U2 — +1 is 

extremal up to time Tq, where 



ifa<l 



, arccosl — ^) if a> 1. 

(Notice that if a < 1, is the time in which the curve reaches A^^(O) and leaves .) Moreover for every 
< a < Ta there exists £ > sufficiently small such that the trajectory starting from (1, 0, 0)"^ and corresponding 
to controls (ui, U2) = (1, 1) in [0, a] and to controls (ui, U2) = (—1, 1) in ]a, a+e] is extremal. The same happens 
if a = Ta and a 7^ 1 . 

Next we call 7++ defined on [0, Ta] , the extremal trajectory starting from (1, 0, O)"'" and corresponding to controls 
(mi,U2) ~ (Ijl)- In the two following propositions we prolong most of the extremals built in Propositions 11 
and 12. 

Proposition 13 Let {x{.), A(.)) be an extremal pair starting from (1, 0, 0)^, corresponding to controls (ui, U2) = 
(1,0) in the interval [0, a] (0 < a < ^) and switching to controls (1, 1) at time a. Then: 

A. If a < 1, there is no other switching before leaving . 

B. If a > 1 and a > arccos(i), there is no other switching before leaving 5*+. 

C. If a > 1 and a < arccos(i), then the control ui switches to —1 at time a + Ta and there is no other switching 
before leaving . 
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Proof. First remember that after time a, the control U2 docs not switch (see Remark 17). Since x{.) is U2- 
singular in [0, a] and corresponds to control mi = 1. we have 0i(a) = 1 and (/)2(a) = 4>3(,ci) = 0. Using equation 
(31) and (32) one easily checks when changes of sign. This allows to check if there is a ui-switching before 
leaving S~^. Moreover remember that once {ui, U2) ~ (—1,1) then there is no additional switching (see Remark 
17). This allows to conclude for the last claim. H 



Remark 19 Notice that in case C. the set of points where the extremal trajectories are switching from controls 
(1, 1) to (—1, 1) describes a curve that is a great arc of circle between the points 7++(Tq) and the target 
(0, 0, 1)"^. Indeed this is a consequence of the fact that the time between A^^(O) (which is a great arc of circle) 
and the Mi-switching is constant. 

Similarly one gets: 

Proposition 14 Let (x(.), A(.)) be an extremal pair, starting from (1, 0, 0)^, corresponding to controls (1, 1) in 
[0, a] with a <Ta and switching to controls (—1, 1) at time a. Then it is extremal until it leaves by reaching 
Aa'(O). 

The following proposition concludes the construction of all extremal trajectories. The proof is similar to 
the proofs above and it is left to the reader. 

Proposition 15 In the case a < 1, for every a G [Ta,Ta + T^] where ~ arccos(a) trajectory starting 
from (1,0,0)"^ and corresponding to controls: 

• (ui,U2) = (1,1) forte [o,rj, 

• ("1,^2) = (1,0) for t e]Ta,al 

• (ui, U2) = (1, —1) for t G [a, b], where b is the last time in which the trajectory stays in , 
is extremal. 

The previous propositions describe all the possible extremals starting from (1,0,0)"^. They are pictured in 
Figure 3. One immediately checks the following: 

Claim: Each point of is reached by an extremal trajectory. Moreover, all the extremal trajectories reaching 
a fixed point, coincide before that point. This allows to conclude that all these extremals are in fact optimal 
and we have built the complete time optimal synthesis for the system (23) starting from (1,0,0)"^. 

Notice that the only points reached by more than one extremal are on Supp{'y'^^) and on the support of 
singular trajectories. These facts are collected in the following: 

Theorem 1 The set of trajectories starting from (1,0, O)"'" and corresponding to the controls given below is a 
time optimal synthesis for the system (23). 

In the sequel we denote by T the last time in which the control is defined, that is the last time in which the 
corresponding trajectory stays in . 
Case a < 1 



("1,U2) 



(1.0) for t e [0,a] with a e [0, f], 

(1.1) forte]a,T]. 



, , , 1,1 /or te 0, a mf/i a G O, ^i^^^tfi , 
for t e]a,T]. 
(l,l)/orte[0, -;gg^) ], 
iui,U2) = <! (0,1) /orte]™j^f \a] with a e] ""J/j^f \ "^/j^f ^ + "■'^7^°) ] 

(-1,1) fort &]a,T]'. 
The curve reaching the target (0, 0, 1)"^ corresponds to following controls: 

f (1,1) forte [0, 

(Ui,U2) = < y 2 ^ ,2-, , s 

\ -L-i -^J 1 /p, 1 \ + ^1 arccos(-Q; ) arccos(-a ) , arccos(a) i 

ij for t e\ , + - J. 
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Figure 3: Image of the synthesis for minimum time with bounded eontrols in the cases a < 1, a = 1 and a > 1 



Case a = 1 



Case a > 1 



(ui,U2 



(1.0) forte [0,a] with a e [0, f], 

(1.1) fort €]a,T]. 
(1, 1) for t e [0, a] with a G [0, 
(-1,1) fort e]a,T]. 

The curve reaching the target (0, 0, 1)"'" corresponds to following controls: 

iui,U2)^{ (lA) forte [0,^]. 



, ■\ „ / (1; 0) /o'' t € [0, a] with a S [arccos(-), 

1 (i,i)/orte]a,r]. 

I (l,0)/orte [0, a] wit/i a e]0, arecos(^)[, 
(ui,U2) = < (1,1) for t €]a, a + Ta], 

[ fort £]a + Tc.,T]. 

I ^_/ (1,1) /or [0, a] wit/i a e]0,ra], 

I (-1,1) /or te]a,T]. 
T/ie curve reaching the target (0,0, 1)"'" corresponds to following controls: 
(1, 0) /or i e [O,arccos(i)], 
(1, 1) for t e] arccos(i), arccos(-4j)]. 



From the controls given above, one can easily get the explicit expression of the corresponding optimal 
trajectories that are concatenations of at most three arcs of circle that are bang or singular. More details about 
optimal trajectories reaching the target (0,0, 1)-^ are given in Section 3.1. 



5 Minimum Energy 

In this section, for the minimum energy problem, we provide explicit expressions (in terms of elliptic functions) 
for optimal controls linking the first and the third level, in terms of a parameter that will be determined nu- 
merically. In the following we restrict our attention to extremal trajectories parametrized by arclength. This 
is possible thanks to the fact that, in this special case, the PMP-Hamiltonian system is Liouville integrable 
(since it is a right invariant Hamiltonian system on S0(3), see Section 5.2). Some efforts are required to prove 
that all extremals arc in fact optimal (see Section 5.3). Similarly to Section 4, as byproduct we get the complete 
optimal synthesis (cf. Remark 4). In the sequel, for convenience of computations, we make a change of variables 
on the controls in such a way that the nonisotropy factor a does not appear in the dynamics, but in the cost. 
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5.1 Change of Variables 



A problem whose dynamics verifies an equation of the form of (13), (17) is said to be right invariant on the 
matrix group 5*0(3). This group is endowed with a very special structure of real semi-simple compact Lie 
group. 

In the following it is more natural to present the problem upstairs (i.e., at the level of the group), and in a 
slightly different way. Actually, we make the change of variables: fi(.) = ui(.), f2(.) = au2(.). In this way, 
at the level of the group 5*0(3), the minimization problem becomes: 



Problem V: 



-vi 
dRg^t) I VI -V2 I , (34) 

^2 

minimize J{vi{.),V2{.)) = / {vf{t) + -^vjit)) dt. (35) 

(7(0) e 5, ff(r)er. (36) 




Here Vi : [0, T] R, for i = 1, 2 are measurable essentially bounded functions, and dRg denotes the differential 
of Rg, where Rg is the right translation by g, i.e., Rgg' = g'g, where g,g' € 50(3). Notice that dRg is still a 
right translation by g. The cost function depending only on the controls (i.e., it is invariant under the group 
action) is called right invariant. The source iS (i.e., the lift of the state one), and the target T (i.e., the lift of 
the state three), are defined in (19), (20). Recall that the first column (■0i(i), V'2(i), "03(0)^ of ff(0 represents 
the position (on the sphere 5*^) of the system downstairs (cf. Formula (18)). Recall moreover that, in the 
minimization (35), to guarantee the existence of minimizers, the final time T should be fixed. In the following, 
we fix T in such a way that the trajectories are parameterized by arclength. 



5.2 Integration of the Hamiltonian System Given by the PMP 

For the problem V the Lie group structure allows a nice formulation of the Pontryagin Maximum Principle. 
To take advantage of this formulation, we need some extra notions, presented in the next paragraph. What 
follows can be found in a more general setting with proofs and further discussions in [1] or [22]. 



5.2.1 Trivialization of the co- Tangent Bundle 

We denote by so(3) the tangent space at identity of the smooth manifold 5*0(3). Its dual space (the vector 
space of all linear functions on so(3)) will be denoted by so(3)*. It is a classical fact that the cotangent bundle of 
SO(3) is globally diffeomorphic to the product 50(3) x 5o(3)*. That is, with each pair (g, P) in 50(3) x so(3)*, 
we may associate a linear form p on rg50(3) defined by p{v) = P [dR~^{v)). Using exactly the same idea, 
the tangent bundle of 5*0(3) is diffeomorphic to 5*0(3) x so(3) by identification of dR-^(TgSO{3)) with so(3). 
Using this formalism, the canonical symplectic form on T*50(3) has a nice expression (see [22]), and we may 
rewrite the PMP in a compact form. 



5.2.2 Hamiltonian of the System 

For the problem V, the PMP-Hamiltonian W (see (22)) can be thought as a map iJ^, : so(3)* M that for 
each Aq G K, and each control v ~ (wi, U2) G is defined by 

H.v{P) = P 

Using this notation, the Pontryagin Maximum Principle writes as follows. Notice that, as proved in [11], it is 
enough to require the transversality condition at the source (and at identity). 




(37) 
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Corollary (Pontryagin Maximum Principle for Right Invariant Problems) Let (v(.), g{.)) G L°°{[0, T], ]R^)x 
Lzp([0,T], 50(3)) be a control-trajectory pair of the system (34-). If {v{.),g{.)) is a solution to the problem V 
then there exists a constant Aq < and a Lipschitzian curve P{.) £ izp([0, T], so(3)*) such that the pair 
(P(.), Aq) never vanishes and for almost every t in [0,T] we have 

= dif,„(,)(P(t))g(t), 

- -ad* P(t) ^ ' 

Moreover 

Hvm{P(t)) = maxHy{P{t)) = const (39) 
P{t){Tidg{t)Sg~^{t)) =0 (Transversality condition). (40) 




))P(t) is defined by ad*,^^^^^^p^^,))P{t){v) = P{t) {[dH,^t){P{t)),v]) 



In the statement of tlie PMP, ad'^^ ^ j-p^^ 

In this case, since there are no abnormal extremals, (see Proposition 3) we can normalize Ao = —1/2. An easy 
computation leads to 



where 



^l(-) 




) and 


V2{.) = a 02(.)- 


r/0 -1 








1 


l)\ 


and 




\ 
















[(• 









1 





Mt) = P{t) 



Notice that 4>i{-) and (f>2{-) are defined as in Definition 4. 

Since the group 5*0(3) is semi-simple and compact, then the canonical Killing form Kill{x,y) — tr{xy) is 
negative definite on the Lie algebra so(3). Hence —^Kill{-, •) provides an isomorphism between so(3) and its 
dual space so(3)*. Using this identification, to each linear form P : so(3) ^ R in so(3)*, we can associate a 
skew symmetric matrix Mp of so(3) in the following way: by definition of Mp, for each matrix TV in so(3), we 
have —^Kill{Mp, N) = P{N). Equation (38) for P can be rewritten in the famous Lax-Poincare form (see 
[23] for a proof and further discussions) 



dMp{t) 
Jt 

where we have identified 5o(3)** with so(3). 



= [dH,,{P{t)),Mp{t)], 



(41) 



5.2.3 Expressions of the Controls 

Let us define mi(.), m2(.), TO3(.) three Lipschitzian functions from [0,T] to M by 

—mi{t) —m3{t) 
Mp{t) =: I mi{t) -m2{t) 
m^{t) m2{t) 



(42) 



for every time t in [0, T]. From the maximality condition (39), we deduce that for almost every t in [0,T], 
we have mi[t) = vi[t) and m2{t) = -^V2{t)- From the transversality condition (40), we deduce U2(0) = 0. 
Equation (41) writes 



dvi{t) _ 
dt 

dm3{t) _ 

dt — 



-m3{t)v2it) 
2 m3{t)vi{t) 

Vl{t)v2{t). 



(43) 



l-g 
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Remark 20 In the case in which a ~ 1 (sec [11]), the system (43) admits the solution vi{t) — cos{Kt), 
V2{t) = sin(/vt), m3 = K, where X is a real constant. If a ^ 1 and m3(0) 7^ 0, the function m^^.) is no more 
constant. 

In the case in which a ^ 1, it is easy to check that the two functions Ki{.) and K2{-) defined by 

K,:te [0, T]^^ (^v, {tf + ^V2 {tf^ , K2:te[Q,T]^^ (^v, [tf - ^^^z (44) 

have zero derivative and hence are constant on the time interval [0, T]. Notice that Ki{.) is just the maximized 
Hamiltonian (39). In the following we normalize Ki = i, that corresponds to parametrize the extremals by 
arclength. In this way our problem is equivalent to a minimum time problem with controls constrained in an 
ellipse (cf. Section 1.1). 

As already said in Section 4, we restrict our study to trajectories that remain in the first positive octant 
5"+. For such trajectories, we want to prove that 7713(0) > 0. Since V'2(-) > 0, we must have i'i(O) > 0. We 
already know (for transversality reasons) that |wi(0)| = 1. Hence t'i(O) = 1. Proceed now by contradiction and 
assume 7^7,3(0) < 0. Equations (43) insure that V2{-) is strictly negative for (strictly positive) small times. This 
implies that < for small times, which contradicts the fact that takes values in 5*+. As a corollary, 

we may state that V2{.) is positive for small times. Using now the classical theory of elliptic functions (see 
[37] chapter XXII for example), we can express Vi{.), V2{-) and 7773(.) as elliptic functions of order 2. Indeed, 
writing, for all t small enough 



1 — a 



2 



V2it)=a^l-vi{t)^, and 7773(0 = ^7773(0)2 - —^(1 - 7,1 (i)2), (45) 
we can express vi(.) as the solution of 



^ = _ ^,,(t)2^^3(0)2 _ _ ^^(i)2)^ (46) 

with 

«i(0) = 1. (47) 

The solution of (46) with initial condition (47) is known for small times (see [37], chapter XXII). Hence we 
have the following: 

Proposition 16 For every extremal trajectory, starting from (1,0,0)^ downstairs (or from S upstairs), there 
exists e > such that, for t G [0,e], it corresponds to controls a.e. given by: 

• 7/7773(0) = 0, then 

vi{t) = 1, (48) 

V2{t) = 0, (49) 

7773 (t) = 0. (50) 

• If a < 1 a7id77i3(0)2 < then 

7)1 (t) = dn (^Vl - t; fc) , (51) 



V2{t) = a k an \^\/ 1 - t; kj , (52) 
msit) = 7773(0) cn(^VT~~a2i;fc^ , (53) 



where we have defined the modulus of the elliptic functions dn, sn and cn to be equal to k ^ "v™'^!*^^ ' 
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Ifa<l and msiOy = then 



^^'^ cosh(Vl — t)' ^ ^ 

V2{t) = atanh(VT~~a2 t), (55) 

^3(t) ^ ^^(^^ . (56) 

cosh(vl — t) 



Ifa<l and 7713(0)^ > t/ien 



7;i(t) = cn (a 7713(0) t;fc), (57) 

772 (t) = a sn (a 7773(0) t; fc) , (58) 

TO3(t) = 7773(0) dn (a 7773 (0)t;fc), (59) 

where we have defined the modulus of the elliptic functions cn, sn and dn to he equal to 



a 7713(0) 



If a > 1, then 



viit) = ^<^ yl ^ t-kj, (61) 



7;2(i) = a^l - fc2 sd ^— t; fc , (62) 



"73 (t) = m3(0) nd y^^^^ t;kj , (63) 
where we have defined the modulus of the elliptic functions cd, sd and nd to be equal to 



It happens that the expressions for vi(.), 7;2(.) and 7773(.) given in Proposition 16 make sense for every time in 
M+. Plugging them into (43). one checks that they are in fact solutions for every time in M+. Therefore we 
have: 

Proposition 17 The result of Proposition 16 holds for every t G M+. 

Remark 21 Notice that, in Propositions 16 and 17, we do not require that the trajectory reaches the target. To 
find the optimal trajectory reaching the target (it happens to be unique), we first prove that all these extremals 
are in fact optimal, and then we determine numerically the value of 7713(0) corresponding to it. In this way, we 
also provide the complete optimal synthesis. 

It is easy to check that the map (<, 7713(0), a) 1— > {vi(t), V2{t)) is continuous. It is also possible to prove that 
this map is actually analytic. Consequently, the map (i, 7773(0), a) '—^ ip{t) is itself analytic. Equations (48) to 
(64) give the form of the optimal controls in the sense that for every optimal trajectory starting from point 
(1,0,0)"'", there exists one 7713(0) such that ?/;(.) corresponds to controls vi(.) and V2{-) as given by equations 
(48) to (64). What remains to do is to prove that all these trajectories are in fact optimal in 5'+. This is the 
content of the next section. First we need some preliminary results collected in the following proposition that 
is illustrated in Figure 4. 
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Figure 4: Decreasing of vi{t) as function of ^3(0) and t 



Proposition 18 // (a, 7713(0)) satisfies a < 1 and 7773(0)^ = , then wi(.) is a decreasing function with 

limit equal to at infinity. If (0,7^3(0)) satisfies a > 1 or 70,3(0)^ 7^ , then vi{.) is a periodic function 
with period 6q,,, 713(0) o.iT'd it is decreasing until . Let us extend the definition of Q a. 7111(0) to couples 

(0,7)7.3(0)) such that a <1 and 7713(0)^ = by setting &a.m3{0) = +00. 

If t, 7^3(0) and 7713(0) are such that 7773(0) < 7713(0) and t < ^ niin{0Q, ,„3(o)i 0Q.m3(o)} then their corre- 
sponding controls satisfy Vi (t) > vi (t) . 

Proof. Tlic proof of the first claims is a direct consequence of formulas (48), (51), (54), (57) and (61) for 
control vi{.). Let us prove the last claim. For t e [0, 6Q^m3(o)/2], vi{t) is given by equation (46). Since the 
right hand side of that equation is strictly decreasing with respect to 7773(0) for 7^3(0) > 0, one concludes, using 
standard comparison arguments in ODEs. H 



5.3 Optimal Synthesis 

In this section, we prove that all the extremals given by Propositions 16 and 17 are actually optimal as long as 
they stay in 5+. 

Remark 22 Recall that in 5+, our minimization problem is a singular-Ricmannian problem. In \ A^^(O), 
the singular- Riemannian structure is in fact a Riemannian one. In spherical coordinates (9, ip), its curvature is 

,^ , (-4(l + a2)_^^_;L_^^2W2cos(2v?)+cos(2 ((/9-6l))+cos(2 ((^ + 61)))) cos(6i)^ ^ 

4a^ sm(t^)^ 

If we were exactly in the context of Riemannian geometry, since the topology of is trivial, this would be 
enough to conclude the non existence of cut-locus or conjugate locus, i.e., that every extremal trajectory is 
in fact optimal. Here, the structure is singular along A^^(O) and a correct proof of optimality via curvature 
requires some care and leads to tedious details. For this reason in what follows we prefer to prove optimality 
without using the concept of curvature. 

The first step is to prove that there is no cut-locus. 



5.3.1 Non Existence of Cut-Locus in 

Recall (see Section 4.2.1) that in 5*+, the functions /i(.) and /2(.) are defined by: /i(7/') = — /2(V') = 
With the same techniques used in Section 4, (cf. Proposition 4) one can easily prove that, since /i(.) < 
(rcsp. /2(-) > ) in Int{S^)^ then wi(.) (resp. 7'2(-)) change of sign only once from positive to negative 
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(resp. from negative to positive). Since for small values of t, V2{t) is positive, we have that V2{.) remains 
positive (resp. strictly positive) as long as the corresponding trajectory belongs to 5*"*" {resp. the interior of 
S~^). In particular, this implies that for every extremal trajectory, is an increasing function of the time. 

Moreover since m3(.) is positive (see equations (50), (53), (56), (59) and (63)), the system (43) insures that 
vi{.) is decreasing as long as the extremal trajectory stays in . Hence we have: 

Proposition 19 Let «(.)), be a trajectory- control pair given by Propositions 16, 17, starting from (1, 0, 0)"^ 

Then leaves in finite time. More precisely setting ip{.) = {'ipi(.),ip2i-),tp3i-)) there exists t G such 
that ipiit) = or ■i/'2(f) =0 and ip{t) € S'^ in [0, t\. Moreover in [0, t\ we have: 

• V2it) > 0. 

• ?/'3(.) is an increasing function. 

• Vi{.) is decreasing. 

Finally every extremal trajectory tp(.) cannot self-intersect in . In other words, for every s < t < t we have 

Now, let us investigate the structure of extremal curves for small time. Using the Hamiltonian equations (43), 
it is easy to compute the 3-jct of the trajectory corresponding to a given 7713(0). One gets that "0(0), ip{0) 
and tp{0) do not depend on 7713(0), but one has V'l (0) = 0, V2 (0) = — q;^7713(0)^ — 1 and t/'s (0) = 2q!^ 7713(0). 
It follows that, two curves, corresponding to two different values of 777,3(0), do not intersect for strictly positive 
(small enough) time. 

Proposition 20 There is no cut locus in S'^ . More precisely for every positive t such that ili{t) and ipit) belong 
to and such that ip{.) and ip{.) are both optimal up to time t, we have ip(t) 7^ ipit)- 

Proof. First notice that, since by hypotheses the two curves are optimal and we are considering only curves 
starting in , then their supports are entirely contained in S^. 

Consider two optimal curves ipi-) a-nd corresponding respectively to m3(0), vi{.), V2{.) and 7713(0), 

V2{.). Since the jets of and ■(/'(•) are different at time zero, it follows that there exists e > such that 

Supp{lp\]o^el) n Supp{lp\]o^^[) = 0. 

If the supports of the two curves do not intersect in , then there is nothing to prove. Assume now that the 
supports of the two curves intersect in S'^ . Let t be the first positive time such that Supp{'il}\-^Qt])(^Supp{'il}\]Qf-^ ) 7^ 
0. Since the curves are parametrized by arclength, and they are optimal, it follows that ip{t) = tpit)- 

Let us first consider the case where ■0(t) G 5*+ \ A^^(O). We may assume that 7713(0) < 7773(0). Since ■(/'(.) 
is optimal, it does not self intersect and reaches the boundary of in finite time. Hence, the support of ?/'(.) 
delimits two simply connected compact domains in 5*^ . In the following we call , the region containing points 

of A^"'^(0) arbitrarily close to (1, 0, 0)"^, and Sj^ the other one. Let us prove that ^{t) cannot be coUinear to V'(t). 
Indeed, on one hand, if these vectors are coUinear with the same versus at t, then vi(t) ~ vi(t). But, thanks 
to Proposition 19, since the two curves are optimal and hence extremal in S'^, their controls wi(.) and wi(.) are 
decreasing until t. Hence, thanks to Proposition 18, t is less than their half periods and vi{t) = vi{t) implies 
"^3(0) = 7773(0). On the other hand, if these vectors are coUinear with opposite versus, then V2{t) = —V2{t) = 
which implies that ip{t) and tp{t) belong to A^^(O). But one can easily check that the only optimal trajectory 
with points in A^^(O), for t > 0, corresponds to 777.3(0) = 0. Let us now prove that ■0(t) cannot be transverse 
to V'(*)- Indeed, since 7713(0) < 7773(6) then, for small time s, ijj{s) belongs to S^. Moreover, since t is the first 
time at which and intersect, then Supp{ip)\]Q f[ C . Hence the only way for ilj{t) to be transverse 

to ip{t) is to point toward 5*^. But this implies that vi{t) < vi{t), which is in contradiction with Proposition 
18. Hence we got the contradiction for the existence of cut-points in \ A^^(O). 

If ip{t) € A^^(O), the previous argument can be adapted in the following way. Computing the 3-jets of ?/'(.) 
and ■0(.) at time t, one can prove that Supp{^\-^Q t[) C S^. Moreover, computing the 3-jets of and ip{.) at 
time zero, one can prove that Supp{ip\]o,t[) C S'l^. It follows the contradiction. H 



25 



5.3.2 Optimality of Extremals 

Proposition 20 allows to prove: 

Proposition 21 Each extremal trajectory issued from (1,0,0)"^ is optimal as long as it stays in S'^ . As a 
consequence, by each point of 5*^ passes only one extremal trajectory such that its support is entirely included 
in . 

Proof. In 5+, wc define the set V by V = A^|(0) U A;^\0) \ {(1,0,0)^}. On V, we define the complete 
order << by: 

• (0,1^2,1/^3) << (0,1/^2,-03) iff 1/^2 > 4>2, 

• (0,V'2,V'3) « (1^1,0,1/^3) if l/'2 > 0,_ 

• (0^1,0, Va) « (1/^1,0,1/^3) iff i/'i < iZ-i- 

From Proposition 20, we know that for every point x in I?, there is only one optimal trajectory issued from 
(1,0,0)^ that reaches x. We define the fmiction <!>(.) which, to each point in V, associates the value 7713(0) of 
the corresponding optimal trajectory. Our goal is to show that $(.) is an homeomorphism between V and M^. 

Optimal trajectories cannot intersect, hence <&(.) is an increasing function. Now, we claim that $(.) is 
actually continuous. Indeed since it is increasing, then, for every x € V, $(.) has an upper limit £{x) on the 
left and a lower limit L{x) on the right at x. If $(.) were not continuous at x, then i{x) < L{x). But both 
extremals corresponding to 7773(0) = £{x) and 7713(0) = L(x) reach x and are optimal as limit of equicontinuous 
optimal curves. This is in contradiction with Proposition 20. Hence $ is continuous. 

As a consequence, since $ is a continuous increasing function, it is one-to-one from I? to a certain interval / 
of K"*". Since ipai-) is a strictly increasing function in the interior of 5+, the trajectory associated to 7713(0) = 0, 
7;i(.) — 1, V2{-) = is the only extremal reaching the point (0, 1,0)"^ and hence it is optimal. This proves that 
S /. Assume now that / is bounded. The knowledge of the jets of the extremals corresponding to 7773(0) 
in / shows that there exists an e > such that every extremal corresponding to 77*3(0) £ I stays in until 
e. But thanks to the continuity of the distance function to (1,0,0)"'", there are points in A^^(O) \ {(1,0,0)"^} 
whose subriemannian distance to (1,0,0)"^ is less than e. Hence these points are not reached by curves with 
7773(0) G / which is a contradiction. Hence / is not bounded. 

Hence, to each value of 7713(0), it corresponds one trajectory in 5+ and one point x in V such that tp{.) 
is the only extremal reaching x. We conclude that ip{.) is optimal in 5*+. H 



5.3.3 Minimum Time of Transfer 

In this section we provide explicit expressions of the minimum time needed to reach the target from the source, 
as function of the nonisotropy factor a and of the value of 7(73(0), that will be determined numerically in the 
next section. 

Recall that Proposition 21 insures that there is only one extremal, reaching the target (0, 0, 1)-'" that remains 
in the positive octant. Since, at (0, 0, 1)^, we have Fi = 0, then vi{T) = 0. 

Actually, thanks to Proposition 18, T is the first root of fi(.). Moreover, it can be seen from equations 
(48), (51) and (54), that, if 7773(0) = 0, or if a < 1 and 7773(0)^ < , then vi{.) has no root. Hence, we have 
the following expressions for the minimum time of transfer as function of a and 7773(0). In the case a = 1, 
7773(0) and the minimum time of transfer have been computed in [111. Set K(fc) := . ds ^ ^ ^ ^j^g 

complete elliptic integral of the second kind. We have: 

K(A;) 

Case a < 1. T — —, where k is given by (60). (65) 

a 7773(0) 

1 TT 

Case a = 1. 7713(0) = ^ and : T = V3-. (66) 
V 3 2 

K(fc) 

Case a > 1. T = , where k is given by (64). (67) 

0^7773(0)2 + a2 _ X 
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Figure 5: Time needed to reach the target and corresponding value of msiO) as function of the nonisotropy 
factor a. 



5.3.4 Upper Bound and Numerical Estimation of 7713(0) 

In this section, we provide a numerical estimation of the initial condition 7713(0) for the optimal trajectory 
reaching the target (0,0, 1)"^. The method consists in using a dichotomy algorithm in the following way. 

Thanks to Proposition 21, optimal trajectories associated to 7713(0) > 7^3(0) leave S""*" at a point of the 
set {ip2 = 0} and optimal trajectories associated to 7713(0) < 7713(0) leaves 5"+ at a point of the set {ipi = 0}. 
Hence, starting from an arbitrary value of 7713(0), at each step, the next value will be chosen smaller if the 
corresponding optimal trajectory leaves at a point of the set {'02 = 0} and larger in the other case. This 
algorithm is of course much more efficient if we provide an a priori upper bound of 7713(0). 

Recall that the problem of minimizing energy in fixed time is equivalent to minimize time with controls 
constrained in the set Va := {{vi,V2) G : Vi+V2/a'^ < !}■ Moreover recall that for the isotropic case a = 1, 
the time to reach the target (0, 0, 1)"^ is -^^-f^- More in general, for an isotropic case with controls constrained 
in the dilated set W^P^^ {(wi,U2) G : vj + < a'^}, a' > 0, the time to reach the target is In 

the following we use the fact that if Va C VF^?°*^ , then the time to reach the target T is bigger than . We 
have: 

Case a < 1. From equation (65), we deduce T < 2 a maio) Vi^ fc'" ' ^'^'^'"'^ ^ given by formula (60). Moreover 
since in this case Va C Wl^°^^ we get 7713(0) < -^-^^= < - 1. 

Case a = 1. 7773(0) = 

Case a > 1. From equation (67), we deduce ^y a'^m3{0)^ + — 1 T < ^--^=i==, where k is given by formula 

(64). Since in this case, Va C W^^^^"" we get T > and hence 7773(0) < Figure 5 depicts the time needed 
to reach the target and the corresponding value of 7773(0) as functions of the nonisotropy factor a. 
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